Adaptive High Fidelity Reproduction System

ABSTRACT

Audio is adaptively associated with speakers, depending on the speaker configuration that is present. Each speaker it receives an audio assignment based on its individual spectral characteristics. As more speakers are added, content is adaptively associated with that you speaker, and taken away from the previous.

This application is a divisional of U.S. application Ser. No. 09/799,460filed Mar. 5, 2001.

BACKGROUND

High fidelity systems attempt to simulate the sound that comes fromactual sound-producing objects. Real music is produced when each of aplurality of different instruments, at a different location, producesits own unique sound. Each instrument also has unique sonic tuningcharacteristics. The real music is produced from these instruments, atdifferent locations, producing sounds. Producing a simulation of thisreal music is the objective of a high fidelity music reproductionsystem.

Movies, in contrast, actually have a different objective for their soundproduction. In the 1980s, movie sound became a format with multiplechannels providing the sound output. This format, called surround sound,produced five or more channels of sound. The channels included left andright main channels for stereo music. A center channel was used for monoparts of the reproduction such as the voice. In addition, left and rightsurround channels were provided for special effects. In addition,additional channels may be provided for sound having specialcharacteristics such as sub woofers. This sound system attempts toproduce the feeling of actually being part of the action depicted by themovie.

SUMMARY

The present inventor believes that an ideal musical reproduction, likereal music, should produce the sound from a plurality of instruments,each coming from its own tuned source that has tuning/music reproductioncharacteristics that is most closely representative of the instrument.The current system of stereo reproduction reproduces most, if not all,instruments, from two different sources (speakers), both of which aretuned the same.

According to the present system, information is produced forreproduction by music reproduction hardware. The information as producedhas a number of separated parts. That is, each stream of audioinformation, such as a song, may have separated parts that form thatstream. In one embodiment, those parts may be tracks on the audioreproduction medium.

The separated parts are adaptively associated with different musicreproduction hardware based on the actual characteristics of thehardware producing the music. That is, for example, the violin soundsmay be produced by the speaker most closely tuned to violins. Anotherspeaker, e.g., most closely tuned to horns, may reproduce the horns.

Another aspect automatically determines specific characteristics of thehardware, and forms a file indicative of those specific characteristicsof the hardware. The contents of that file is used to adaptivelyassociate the content of the media, e.g., the music, with the hardware.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other aspects of the invention will be described in detailwith reference to the accompanying drawings, wherein:

FIG. 1 shows a block diagram of the system;

FIG. 2 shows a wired connection between amplifier and speaker;

FIG. 3 shows a wireless connection;

FIG. 4 shows a flowchart of operation;

FIGS. 5A-5D show different ways of storing information for use in thepresent application.

DETAILED DESCRIPTION

Modern audio reproduction media may have more space for storing the datathat is indicative of the audio. For example, the so-called DVD may have100 times the storage capability of a standard CD, also known as a“Redbook” format CD. Various enhanced CD formats have also beensuggested which provide more data on the media and that can be used tostore more information. In addition, modern compression formats, such asthe MP3 format, allows reducing the size that is occupied by informationplaced on the media. Again, this has the effect of allowing the media tostore more information.

Broadband channels are also available. For example, satellite radiochannels are proposed. Broadband Internet channels have been used. Inaddition, audio content may also be produced over a cable and the like.

The present system will be described with reference to information beingstored on the audio medium. A plurality of tracks are provided on themedium. The tracks each include information about a different aspect ofthe audio stream that is recorded on the medium. The audio medium isshown here as being a disk, but it could be understood that anydifferent kind of audio containing medium could be used with the systemof the present invention.

Each track may represent a specified kind of information. In one aspect,each track includes information about the same kind of instruments. Theinstruments included on a single track may be of the same time, e.g. allviolins, or may have the same spectral characteristics, that is allstring instruments, or all producing output within a specified spectralregion, or primarily within a specified spectral region. Sounds may begrouped based on spectral characteristics, e.g., by using a fast Fouriertransform on recorded sound from the instrument. Each instrument may becharacterized on the spectrum, e.g. by forming a histogram indicatingthat amount of energy in each spectral bucket. Alternatively,instruments or sounds which may effectively compress may be groupedtogether. The instruments which are sufficiently similar may be groupedtogether as a track. This has a number of advantages in the context ofthe present system. First of all, it makes the information on the trackmore compressible by certain compression systems such as MP3, since eachinstrument on the track has similar characteristics. In addition, onreadout, the track can be accurately reproduced by the same kind ofreproduction equipment.

Multiple tracks are placed on the medium for different purposes. Forexample, a single medium may include movie style tracks such as left,right, center, left surround and right surround, and also a subwoofersetting. The left and right tracks on the medium represent the stereoinformation. The remaining information in the tracks may representinformation from different individual instruments or instrument types.This information may include separate tracks for each of voices,strings, winds, guitar, percussion, bass strings, and bass winds, withthe understanding that a each different instrument may also be broken upbased on its characteristics e.g. bass or treble. The above hasdescribed 13 tracks for each stored item of information. It should beunderstood, however, that there may be fewer or more tracks, e.g. up to20 tracks. Since each track may represent information of the specifiedinstrument type, the information in the track may be highlycompressible.

As can be seen from the above, the medium will typically include moreinformation that is necessary to actually playback the audio on anysystem. For example, the medium may include stereo left and stereo rightchannels. However, on some systems, 10 speakers may be provided fordifferent instrument types, and this information includes parts of theinformation that is also within the left and right stereo. If theseparated channels are used, the audio left and audio right informationmight not be used. Therefore, the audio medium may include redundantinformation. Adaptive decisions are made during playback indicatingwhich speakers and or which music reproduction equipment gets whichcontent.

An embodiment is shown in FIG. 1. A disk 100 includes a plurality oftracks of information. For example, if the tracks above are used, thestream, shown as 110, may include 13 different channels. The medium mayalso include control track 105 which may be a data track includinginformation about which tracks on the medium include which information.

The medium is read out by a player. The contents of the medium isinterpreted by the adaptive element that is either in the player, or ina controller or amplifier associated with the player. The adaptiveelement is shown herein as 150, and as being part of the amplifier.

The amplifier is connected to a plurality of different speakers ordifferent amplified speakers. Each speaker system, such as 155, hasspecified spectral and/or other sound producing characteristics. In anembodiment, each speaker may also be active, in the sense that itincludes an electronic module associated with the speaker. Thatelectronic module allows communication with the speaker, and may includeinformation about the speaker's characteristics. In another embodiment,characteristics of the speakers may be obtained in a different way.

The characteristics of the speaker may be communicated to the memory 165over the speaker wire using serial formats such as universal serial bus,or RS 232 for example. Alternatively, the amplifier 150 may include amedium reading capability shown as 170. This reading capability may reada storage medium, such as a floppy disk, memory stick, CD, or mini CDwhich is inserted therein. The medium includes information about thespeakers, which is then read from the medium, and stored in the memory.Another way of communicating information is to obtain characteristicsfrom a public network such as the Internet.

In another aspect, each speaker that is purchased is provided with anaudio medium such as a CD or DVD. That audio medium is intended to beplayed in the CD player associated with the stereo. The contents of theCD are played as normal CD audio. However, electronic information aboutthe speakers is encoded in the CD audio. Thus, this includes a specifiedcode that can be read by the amplifier 150, and indicates that speakerinformation follows. The following information includes speakerinformation.

The main amplifier 150 includes also a processor 170 which makesadaptive decisions about which speakers will be selected to play eachtrack or channel on the medium. This adaptive decision will be based onthe specific characteristics of the speakers, and the specificcharacteristics of the audio. The decision is based on, of course, thespecific hardware which is present in the system. More hardware,actually more speakers, in the system, will enable better sound. Whenfewer speakers are present, tracks will need to be combined. In theminimum configuration, only two speakers are present, and the standardstereo is played. Each time a speaker is added, it receives multipletracks assigned to be played to it, based on its spectralcharacteristics. This enables the user to make purchases based on theirpreferences. The user who likes the sound of strings, for example, maypurchase a speaker that is tuned to strings. When this speaker is addedto the amplifier system 150, its characteristics are stored in memory165. Playing of media will thereafter assign information from the media100 to those speakers, based on the speakers characteristics.Conversely, other speakers for horns, and other instruments may also bepurchased. Each speaker is adaptively associated with the content forthose speakers. Each extra speaker is assigned with sound, and thatsound is hence not played by the other speakers. Therefore, morespeakers allow better reproduction of the sound.

Different ways of getting the information into the memory are alsoconsidered. FIG. 2 illustrates up plug and play type operation of doingthis. In FIG. 2, the amplifier 250 is connected via a standard lineconnection to the speaker 260. The speaker 260 includes an electronicsmodule therein 265. The module 265 communicates with a correspondingmodule in the amplifier, using any serial protocol but preferablyEthernet, USB, or RS 232. Any protocol that may communicate over a 2wire line may be used. In this embodiment, the amplifier may poll thespeaker using a low voltage level signal. Since the signal is at a lowvoltage level, it will produce little if any sound out of the speaker.However, the electronics module 265 within the speaker may stillrecognize this as control signals. The speaker responds with informationindicative of its individual spectral characteristics. This informationis then stored in the memory 165 within the amplifier. The informationmay also be used in the playback mode, to determine channel allocationsfor the information from the media.

A wireless alternative is shown in FIG. 3. This may use wireless formatssuch as bluetooth, wireless LAN, or some other wireless format. FIG. 3shows a bluetooth module 310 in the speaker 300. The amplifier 350 alsoincludes a bluetooth module shown as 355. Again, this system may operateby polling. The speaker may respond to a poll with informationindicative of the speaker's individual characteristics. This informationis then stored in the memory 165.

In any of these embodiments, the user can purchase more speakers at anytime. Settings for the music are automatically determined by thecharacteristics of the speaker.

The above-described operations may operate according to the flowchart ofFIG. 4, which may run in the processor 170.

At 400, the system polls all speakers. This may be carried out at eachtime of power on, or may be carried out only once for example on initialconnection. The speakers may also include the capability of determiningroom acoustics, in which case it may be desirable to poll the speakersat each power up, or at time intervals.

At 405, the system determines settings based on the polling. Thesesettings may optionally be displayed at 410. At 415, the content of thetracks is adaptively associated with the user's individual stereo setup.

The above has described the information stored on the medium. This“enhanced” information may be stored on the media in a number ofdifferent ways.

FIG. 5A shows the medium being a disk with a first portion that hasnormal CD stereo 500, that can be read by any CD player, and reproducedthrough normal stereo equipment. A second, enhanced portion of the disk505 includes multitrack enhanced information. Since the first portion isthen typical CD form, this setup will require that the medium haveadditional space available. An advantage of this system is that themedium can be read on any standard CD player.

FIG. 5B shows another system in which the entire medium is stored inmultitrack format. In this system, the standard stereo information isinterleaved with other tracks of additional information. Standard CDformat includes headers that are specified by the standard. Theseheaders include information such as P and Q parts. These headers includesignals that instruct a standard CD player to ignore certain parts ofthe data stream that is stored on the disk; those parts being reproducedonly by enhanced players. For example, CDs may include capability ofquad reproduction, and the enhanced information tracks could be labeledas quad, so that a standard player ignores this information.

FIG. 5C shows another alternative in which a dual cited disk has a firstside 520 representing normal information and a second side 525 which isan enhanced disk.

While the above has described the information being present on the disk,it should be understood that other forms of reproduction and obtainingof information are possible. All such forms are intended to beencompassed.

Other embodiments are within the disclosed invention.

1. A musical reproduction device, comprising: a musical reproductionelement, which receives information indicative of audio information tobe played through audio reproduction equipment via at least one port onsaid musical reproduction element; a memory, coupled to said musicalreproduction element, and storing spectral information about multipledifferent spectral characteristics of multiple different audioreproduction equipment; and a communication part, controllingcommunication of said audio information from said musical reproductionelement indicative of audio information directed to different audioreproduction equipment, said controlling being based on said spectralinformation indicative of said spectral characteristics stored in saidmemory, and wherein said communication part determines a spectral makeupof said audio information, determines, based on said spectralinformation stored in said memory, which audio information has spectralcharacteristics that best match to spectral characteristics of specificaudio reproduction equipment, where a first audio information with afirst spectral characteristic matches to first spectral characteristicsof a first audio reproduction equipment and is communicated to saidaudio reproduction equipment based on said determines, and where asecond audio information with a second spectral characteristic matchesto second spectral characteristics of a second audio reproductionequipment and is communicated to said audio reproduction equipment basedon said determines.
 2. A device as in claim 1, wherein said at least oneport comprises a USB port.
 3. A system as in claim 1, wherein said atleast one port comprises a memory reading port.
 4. A system as in claim1, wherein said audio reproduction equipment includes a speaker.
 5. Acomputer, receiving information about specific parameters related tospectral characteristics of plural different audio reproductionequipment, including at least a first audio reproduction equipmenthaving first spectral characteristics, and second audio reproductionequipment having second spectral characteristics different than saidfirst spectral characteristics, and said computer using said parametersto make a determination about which of plural sounds should be sent towhich of plural sound reproduction devices.
 6. A computer system as inclaim 5, further comprising a USB port, providing connection to theaudio reproduction equipment.
 7. A computer system as in claim 5,wherein said audio reproduction equipment includes speakers.
 8. Acomputer system as in claim 7, further comprising a wireless connectionto the speakers.
 9. A computer system as in claim 7, further comprisinga USB port, providing connection to the speakers.
 10. A computer systemas in claim 9, wherein said spectral characteristics are communicatedover said wireless connection.
 11. An audio player comprising: adecision module, receiving information about specific parameters relatedto spectral characteristics of plural different audio reproductionequipment, including at least a first audio reproduction equipmenthaving first spectral characteristics, and second audio reproductionequipment having second spectral characteristics different than saidfirst spectral characteristics, and said decision module receiving audioto be played from an audio source, and determining spectral informationin said audio to be played, and using said parameters to make adetermination about which parts of said spectral information should besent to which of plural sound reproduction devices and producing outputsindicative of said decisions.
 12. A player as in claim 11, wherein saidaudio reproduction equipment includes speakers.
 13. A computer system asin claim 12, further comprising a wireless connection to the speakers.14. A computer system as in claim 13, wherein said spectralcharacteristics are communicated over said wireless connection.
 15. Aplayer as in claim 11, further comprising a USB port, providingconnection to the audio reproduction equipment.